Growing Random Networks with Fitness 
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Three models of growing random networks with fitness dependent growth rates are analysed using 
the rate equations for the distribution of their connectivities. In the first model (A), a network 
is built by connecting incoming nodes to nodes of connectivity k and random additive fitness rj, 
with rate (fc — 1) + rj. For > we find the connectivity distribution is power law with exponent 
7 =< ri > +2. In the second model (B), the network is built by connecting nodes to nodes of 
connectivity k, random additive fitness rj and random multiplicative fitness ( with rate C^{k— 1) +7]. 
This model also has a power law connectivity distribution, but with an exponent which depends on 
the multiplicative fitness at each node. In the third model (C), a directed graph is considered and 
is built by the addition of nodes and the creation of links. A node with fitness (q,/3), i incoming 
links and j outgoing links gains a new incoming link with rate a{i + 1), and a new outgoing link 
with rate P{j + 1). The distributions of the number of incoming and outgoing links both scale as 
power laws, with inverse logarithmic corrections. 



PACS numbers: 02.50.cw, 05.40.-a, 89.75Hc. 
I. INTRODUCTION 

Recently, there has been a considerable interest in the 
growth properties of human interaction networks such as 
the world wide web , the citation distribution of pub- 
lications 1^ , the electrical distribution systems Q and the 
social networks |^ . These networks all have very different 
physical forms, with different definitions for their nodes 
and links. However they appear to display considerable 
topological similarity, having connectivity distributions 
which behave as power laws. These distributions cannot 
be explained by traditional random graph theory, which 
is based on randomly connecting together a fixed num- 
ber of nodes, and results in Poisson distributions for the 
connectivity 

Models of growing random graphs were first introduced 
by Barabasi and Albert |Q, who identified two impor- 
tant features that these graphs must possess in order to 
display power law distributed connectivities. These fea- 
tures are (i) networks grow by addition of new nodes and 
{ii) new nodes preferentially attach to highly connected 
nodes. Consideration of only these elements in Q led to 
the conclusion that large networks can self-organize into 
a scale free state. Since then, many other models P-p^j 
have emerged to study various properties of these graphs 
such as aging connectivity jll), inheritance p2| , 

permanent deletion of links and nodes and their ef- 
fect on a growing network topology. The main conclusion 
of all these models is that incorporation of additional fea- 
tures changes the scaling behaviour of growing random 
networks. However it is still not understood why most 
of the empirical work observes power law exponents be- 
tween 2 and 3, and the analytical work recovers expo- 
nents that range between 2 and oo ^,0. Furthermore, 
some of the more detailed features of the networks have 
not yet been captured P,[l9|. 



ness, on the growth rates of networks. Similar ideas have 
been studied in other models, either through the initial 
attractiveness of a node ||] or the fitness of a site to com- 
pete for links [|l^. However, our approach is somewhat 
different to these models. We use a rate equation ap- 
proach I ll| to generalize and solve three network models 
with different growth rates. 

In Sec. ||, we investigate the effect of additive ran- 
domness, while t he e ffect of multiplicative randomness is 
analyzed in Sec. HI. In Sec. 

20| 



is a directed graph 



IV, we assume the network 



and both incoming and out- 
going links are considered, to model the growth of the 
world wide web. We summarize our results and draw 
conclusions in the last section. 



II. MODEL A 

In this model, we consider a network where a fitness rj, 
chosen from a probability distribution fAiv)! is assigned 
to each node. The network is built by connecting incom- 
ing nodes to nodes of connectivity k and fitness 77 with 
rate (fc — 1) -|- 77, that is to say, there is a linear prefer- 
ential attachment to nodes with already high number of 
links and a high fitness ry. This simply means that not 
all nodes which k existing links are equivalent because k 
does not enclose the full information about the popularity 
of a node. For instance, if a node is a web site, rj could be 
a measure of the number of related TV commercials, or 
tube advertisements. Using the rate equation approach 
we describe the time evolution of the average number of 
nodes of connectivity fc and fitness r/, Nk{ri), as 



+SkifA{v)- 



(1) 



In this paper, based on an idea introduced by |10| we 
study the influence of quenched disorder which we call fit- 



The first term on the right hand side of Eq. (|^) represents 
the increase in the number of sites with fc links when a site 



with k — 1 links gains a link. The second term expresses 
the loss of sites with k links when they gain a new link. 
The last term accounts for the continuous addition of 
nodes of connectivity 1 and fitness rj with probability 
fA{f])- The multiplicative factor M is defined by 



M(t)-^(fc + ,7-l)iVfc(77), 



(2) 



which ensures that the equation is properly normalized. 
Before going any further, let us make some remarks. 
First, to obtain a growing network, we need fc — 1 + 77 > 
for all fc, so that 77 > 0, because from the definition of 
the model, each site is created with one link. Second, all 
sites associated with 77 = 1 have the simple linear pref- 
erential attachment of earlier models |Q,|ri|,Q . Finally, 
/a (77) can either be discrete or continuous. 

We analyse the model from the rate equation starting 
with the moments of Nf.(r]) defined by 



k,ri 
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We can easily show that 
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(3) 



(4) 



where < 77 > is the average value of the fitness. For 
large times, the initial values of the moments become 
irrelevant, so that we get 

M{t) = Mio(i) + Moi(t) - Mooit) = [< 77 > +l]t. (5) 

Similarly, it can be shown that N^irjjt) and all its mo- 
ments grow linearly with time. Therefore, we can write 
Nk{r},t) — trikirf) and M{t) = mt. The latter relation 
implies m —< rj > while we insert the former in 
Eq.(|l]) to obtain the recurrence relation 

(fc + 77 + 77T, - 1)71^(77) = (fc + 77 - 2)77fc_i(77) + m5kifA{v)- 

(6) 

Solving Eq. (0), we obtain 



r(fc + 77-l) ^(77 + 77^) 
T{k + ri + mj r[r]) 



(7) 



In particular, the rate of change of the total number of 
links connected to the sites with fitness 7/ is equal to 



^kukir]) = 1 



7/ 



For large fc, Eq. is equivalent to 

rikiv) ^ fc-("+i) ^ fc-«'7>+2) 



(8) 



(9) 



The distribution scales as a power law nkirj) ~ fc ^ 
with an exponent 7 =< 77 > +2, which depends only 



on the average fitness < 77 >, and consequently is the 
same for every node. Hence, the introduction of an ad- 
ditive random fitness at each node, modifying the pref- 
erential attachment process, generates a power law con- 
nectivity distribution. The exponent of this power law is 
shifted by < 77 > —1 with respect to its value when the 
preferential attachment is simply linear. Of course, for 
/a(77)=<5(77-1), 



(10) 



which is, as expected, the result obtained in previous 
models without fitness 0,0,0. 



III. MODEL B 

In the previous section, we introduced a model where 
linear preferential attachment is decorated by a random 
additive process to construct an independent source of 
preferential attachment. However, even if it seems rea- 
sonable to assume that the attachment is proportional 
to the number of already existing links, there is no spe- 
cific reason to assume that the coefficient of proportion- 
ally is the same for every node. In this section, we con- 
sider a network where each node is associated to a triplet 
(fc,77, (^). The network is built by adding a new node at 
each time step and connecting it to a node with random 
additive fitness 77, random multiplicative fitness C and 
connectivity fc with rate C(fc — 1) -I- 77. Where 77 and C 
are quenched variables, initially chosen from a probabil- 
ity distribution /b(77,C)- This model is a generalisation 
of that introduced in , and Model A is recovered when 
C) = /a(?7)^(C The multiplicative fitness sym- 
bolizes the fact that, even if the growth rate is propor- 
tional to already existing links, there can exist different 
categories of nodes which attract new links at different 
rates. 

The rate equation for this model, which describes the 
time evolution of the average number of nodes with 
triplet (fc, 77, C), A^fc(?7, C). is given by 



dt 



1 

M 



([C(fc-2)-H77]iVfe_i(77,C) 



-[C(fc-l)+77]iV,(77,C)) +4i/s(r/,C)- (11) 



The terms on the right-hand side of this equation are 
analogous to those in Eq. (|^), with the new preferential 
rates of growth. The normalization factor here is 



(12) 



To solve Eq. (|ll|), we employ the same technique as in 
the previous section, defining the moments of Nk{ri, C) by 



ijl 



J2 kwc'Nkivx). 



(13) 
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Looking at the lowest moments of Nk{ri, (), we find 

^^^^^^ = /U7 E - 1) + '?]^^('?' 0+ < V >, (14) 



dt 



where < 77 > is the average additive fitness. Again, it 
is easy to prove that Nk{ri, ^, t) and all its moments are 
linear functions of time. Hence, we define m and nk{r], ^) 
through M{t) = mt and A^fc(r/, C, = ^"-^(r/, C), respec- 
tively. We refer to m as the reduced moment from now 
on. 



of 



Eq. (14) implies that the reduced moment is a solution 



- Y] C[C(fc - 1) + vWiv, 0+ <v> 



(15) 



From Eq. (|ll|), we obtain 



[C(fc - 1) + 7? + TO]nfc(C, V) = [Cik - 2) + 7]]nk-i{C, v) 

+m6kifB{C,v)- (16) 



The previous relation yields 



r(fc + !-i)r(^^^ 



When k — > 00, 



nk 



(77,C)~fc-(i+f). 



/s(ry,C)- (17) 



(18) 



The growth rate of the number of sites associated with 
a triplet (fc,77, C), scales asymptotically as a power law 
nk ~ fc"''', with an exponent 7 = l + m/C, which depends 
on the fitness at a particular site. It means that, unlike 
the additive fitness, the multiplicative fitness generates 
multiscaling, with a different power law for each fitness. 

To complete the solution of the model, we need to ob- 
tain an expression for the reduced moment, to. For this 
purpose, we introduce a generating function defined as 



fe=i 

Eq. (Q) gives 

00 

5(1,?7,C) = fsivX) = ^nk{v,C) 

and 



(19) 



fe=i 



77 — C + TO 



^/i3(^,c)-E^"fc(^'C)- 

^ fc=i 



(20) 



(21) 



Substituting in Eq. (HSh leads to an implicit equation for 



m — ( 



dr]d( = l 



(22) 



which cannot be solved explicitly. We can define Uk, the 
connectivity distribution of the entire network, as 



nk= fcivX)nkivX)dvdC- 



(23) 



As an example, we consider /_b(?7, C) = 1, < 77 < 1 



and < C < 1- Solving Eq. (^21 ) gives to = 1/(1 - 



1.156 and, integrating Eq. (hTu over 77 and C within the 
chosen limits. 



1 pi 



nk = 



fc-(f+i) 



p / ri+m \ 
1) V c ) 



oJo 



C 



drjdC,. 



(24) 



We find that the connectivity distribution in the asymp- 
totic limit fc — > 00 is 



1 



nk 



h^^ 



(25) 



This is simply a power law form multiplied with an in- 
verse logarithmic correction and substitution of to yields 

1 



nk 



-2.156 



In/c 



(26) 



By using fsivX) — ^(C — v) with < C < 1, the solu- 
tion obtained by pO[ | is recovered, which has the same 
functional form as Eq. ( p5| ) with a power law exponent 
7 = 2.255. 

We can solve for the large k behaviour of the connec- 
tivity distribution for a number of different forms of the 
fitness. For instance, if 



/B(77,C)=aC-M(C-77) 



(27) 



and 0<^<l,a>0, then the connectivity distribution 
behaves as 



nk 



1 

In k 



,^-(m+l) 



as fc — > 00 and to (a) satisfies 



dC = 1. 



(28) 



(29) 



/o ni-C 

Using this equation it is simple to show that as a ^ 0, 
TO — > 1 and as a 00, TO — > 2. In Fig. (|l|) this equation 
is solved numerically. We find that 1 < to < 2, implying 
that the power law exponent is in the range of (2,3) which 
is in very good agreement with the experimental results 



(30) 



Another example to consider is when 
/b(^,C) = 6C(1-C)'5(C-'7) 



with < C fi: 1- this case the connectivity distribution 
takes the form 



1 



nk 



as k 



(ln/c)2 
00 where to — 1.550 



(31) 
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FIG. 1. m against a for Model B when the multipUcative 
fitness is distributed as a power law with exponent a — 1. The 
inset is the region close to the origin. 



IV. MODEL C 

In the previous two models, the links were undirected 
and the number of hnks and nodes were equal, which is 
not a good model for some growing networks such as the 
www. In this section, a directed network is built by node 
and link addition. At each time step, with probability p, 
a new node is added and with probability q = 1 — p, a 
new directed link is created between two nodes. A node 
with fitness (a, i incoming links and j outgoing links, 
will gain a new incoming link with rate a{i + l) and a new 
outgoing link with rate /3(j + 1). Then, the connectivity 
distribution Nij(a, (3), the average number of nodes with 
i incoming and j outgoing links, evolves as 

BN ■ on 

^(«,/3) = 1^ [*iV,_y(a,/3) - (^ + l)iV,,(a, /?)] 



+ 



9/3 



[jiV,,_i(a,/3)-(j + l)%(a,/3)] 



M2 



(32) 



The first term in the first square brackets represents the 
increase of iVy nodes when nodes with i — 1 incoming 
and j outgoing links, gain an incoming link and the sec- 
ond term represents the corresponding loss. The second 
square brackets contain the analogous terms for outgoing 
links and the last term ensures the continuous addition 
of new nodes with fitness a, /3 with probability fc[oi, (3). 
Ml and M2 are the normalization factors, given by 



Ml = ^{i + l)aNij (a, /?) and 

M2 = Y.{j + i)mM.P)- 

From the definition of the model, one has 



(33) 
(34) 

(35) 



which simply states that nodes are added with probabil- 
ity p. We also have 



aNij (a, /3) = p < a> t 

ijap 

^/37V,,(a,/3) = p</3>t. 

ijcxfS 



(36) 
(37) 



We define nij{a,f3) through Nij{a, P,t) = triij, where 
from now on we drop the explicit (a, /?) dependence to 
ease the notation. Also, we can define the reduced mo- 
ments mi and m2 by Mi(t) = tmi and M2{t) = tm2. 
Hence we have 



mi = a^U + l)nij + p < a > 

mi ^ 



(38) 



(39) 



and similarly 

m2 = — V /3^(j + l)n,j +p<l3> . 
m2 ^ 

From Eq. (^), we obtain 

n.ij[mim2 + raiq(3{i + 1) + m2qa{i + 1)] 
— 1712 qaiui^ij + mi qP jriij^i 
+mi m2pS.ioSjo fcia, (3). 

Now, we consider the incoming link distribution 

00 

j=o 

and the outgoing link distribution 

00 

hj = riij . 

i=0 

From Eq. (|40|), the recurrence relations 



z + 1 + — ) 5, = z.g,_i + ^S.ofcia, (3) (43) 
qa J qa 



(40) 



(41) 



(42) 



and 



+ ^ + if) = + ^^^^ 

are obtained. Solving these gives the incoming and the 
outgoing links distributions 



r(z + i)r(Hii + 1) 



mip 



r(2i^ + z + 2) qa 



and 



r(j + i)r(i^ + i) m2P, , „, 
'^■= r(H| + , + 2) 



(45) 



(46) 



4 



In the asymptotic limit both distributions are power laws; 
as i ^ oo, gi ^ with 7j„ = (1 + mi/qa) and for 

j oo, hj - j-w with jout = (1 + m2/qf3). 

The appearance of both multiplicative fitnesses a and 
P in the exponents of the power laws, reflects the fact that 
growing networks such as the www are evolving on the 
basis of competition. The fitnesses here, can be thought 
of as a measure of attractiveness of the content of a web 
page. This means that within a particular commercial 
sector on the web, such as search engines, e-mail ac- 
count providers, the software design, films, music and 
specific information, the fittest competitors have man- 
aged to gather millions of registered users in a very short 
span of time. 

To express these exponents numerically we will find 
implicit equations for toi and m2. Therefore, we use a 
generating function defined as 



g{x,y,a,P) = ^ 



to find equations for mi and TO2- We have 
5(1,1) =p/c(a,/3) 



and 



Hence 



dx 



pqa 



-fc{a,/3). 



E 



pqa 



TOi — qa 



-fc{a,P) 



(47) 



(48) 



(49) 



(50) 



and by an identical method 

pq(3 



7712 - qP 



fcia,f3). 



Substitution of the above relations into Eq. ([ 
Eq. (p9) gives implicit equations for 77ii and 7^2, 



a,/3 



mi — qa 



1 



and 



P2_^ ^ = 1' 



a, 13 



7772 - g/3 



(51) 



and 



(52) 



(53) 



respectively. The summations run over all possible val- 
ues of a and (3 and can be replaced by integrations for 
continuous distributions. 

First, we consider a general case; if 



fc{a,(3)^ fcW,a) 



(54) 



then the distribution of incoming and outgoing links is 
the same, = h^. 

As with Model B, we will consider two particular non- 
trivial distributions of the fitness. For power law fitnesses 



-1 ob-l 



fcia,P)^aba--'(3 



(55) 



we find that the distribution of incoming links is given 
by 



9t 



1 

In 7 



^(1+^) 



and analogously for outgoing links 



1 

Inj 



J 



(1+^) 



(56) 



(57) 



for large i and j. The parameter 7771 is a function of both 
a and p and 7772 is a function of b and p. It is a simple 
matter to show that mi{a) = g{a) and 7772(6) = g{h) 
where g{c) satisfies 



P 



5(c) - qx 



dx — 1. 



(58) 



Consequently, as a ^ 0, 7771 — > q and as a ^ cxd, 7771 
1. Thus by picking a appropriately, the power law in 
the distribution of incoming links Eq. (|5^) can have an 
exponent with any value between 2 and l-fl/q. A similar 
situation occurs with 7772(6). 

The fitnesses for incoming and outgoing links can be 
more strongly coupled together. An example of this is 



/c(«,/3) 



2 a > /3, 
I3> a 



(59) 



where we find that for large i and j, gi has the same form 
as Eq. (|5l) and 



(lnj)2 



(60) 



The stronger coupling between the fitnesses is reflected 
in the different functional forms of the probability distri- 
butions for incoming and outgoing links. 



V. DISCUSSION AND CONCLUSIONS 

We have studied three growing network models with 
the consideration of two key elements in mind; (i) net- 
works are continuously growing, (ii) the attachment pro- 
cess is preferential. In the first model in Sec. |l|, we 
found that the introduction of random additive fitness 
(quenched disorder) rj at each node modified the prefer- 
ential attachment process and the generated network had 
a power law connectivity distribution with an exponent 
7 =< 77 > -1-1, where only the average value of the fitness 
is of importance. However, introduction of both random 



5 



addi tive fitness rj and random multiplicative fitness in 
Sec. in, led to a scale free network where the exponent 
-f = 1 + m/C depends on the fitness C at each node. When 
the fitnesses were distributed with a power law distribu- 
tion between and 1, the connectivity distribution of the 
whole system was power law with a logarithmic correc- 
tion, with the value of the exponent in the power law 
between 2 and 3. 

In Sec. we studied a directed graph which was 
allowed to form loops in an attempt to model a differ- 
ent class of growing random graphs. The incoming and 
the outgoing link distributions exhibit power law forms 
with exponents corresponding to 7™ = (1 -I- rrii/qa) and 
7oMt = (1 + TTi2/ql3) depending upon the values of the 
fitness at each site. Choosing a particular fitness distri- 
bution and calculating the connectivity distribution for 
the whole system often results in power laws mediated by 
logarithmic corrections. We gave two examples of such 
behaviour. 

There are a great many examples of random growing 
graphs in science, social science, technology and biology. 
Only a fraction of these systems have been characterised 
experimentally. Whilst the systems studied in this pa- 
per are not as theoretically appealing as those with pure 
power law forms, it seems likely that some of the real 
random growing networks will be described by models of 
this particular type. 
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